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ANTIPODE FORMULAS FOR SOME COMBINATORIAL HOPF ALGEBRAS 


REBECCA PATRIAS 


Abstract. Motivated by work of Buch on set-valued tableaux in relation to the AT-theory of the 
Grassmannian, Lam and Pylyavskyy studied six combinatorial Hopf algebras that can be thought 
of as AT-theoretic analogues of the Hopf algebras of symmetric functions, quasisymmetric func¬ 
tions, noncommutative symmetric functions, and of the Malvenuto-Reutenauer Hopf algebra of 
permutations. They described the bialgebra structure in all cases that were not yet known but 
left open the question of finding explicit formulas for the antipode maps. We give combinato¬ 
rial formulas for the antipode map for the A'-theoretic analogues of the symmetric functions, 
quasisymmetric functions, and noncommutative symmetric functions. 


1. Introduction 

A Hopf algebra is a structure that is both an associative algebra with unit and a coassociative 
coalgebra with counit. The algebra and coalgebra structures are compatible, which makes it a 
bialgebra. To be a Hopf algebra, a bialgebra must have a special anti-endomorphism called the 
antipode, which must satisfy certain properties. 

Hopf algebras arise naturally in combinatorics. Notably, the symmetric functions (Sym), qua¬ 
sisymmetric functions (QSym), noncommutative symmetric functions (NSym), and the Malvenuto- 
Reutenauer algebra of permutations (MR) are Hopf algebras, which can be arranged as shown 
in Figure 


MR-MR 


NSym-QSym 


Sym-Sym 

Figure 1. Diagram of combinatorial Hopf algebras 

Through the work of Lascoux and Schiitzengerger |LS] . Fomin and Kirillov |FK96] . and 
Buch |Buc02j . symmetric functions known as stable Grothendieck polynomials were discovered 
and given a combinatorial interpretation in terms of set-valued tableaux. They originated from 
Grothendieck polynomials, which serve as representatives of iC-theory classes of structure sheaves 
of Schubert varieties. The stable Grothendieck polynomials play the role of Schur functions in 
the iC-theory of Grassmannians. They also determine a A-theoretic analogue of the symmetric 
functions, which we call the multi-symmetric functions and denote mSym. 
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In |LP07] . Lam and Pylyavksyy extend the definition of P-partitions to create P-set-valued 
partitions, which they use to define a new iP-theoretic analogue of the Hopf algebra of quasisym- 
metric functions called the Hopf algebra of multi-quasisymmetric functions. The entire diagram 
may be extended to give the diagram in Figure 

mUR -mMR 


OflNSym-mQSym 


IDTSym-mSym 


Figure 2. Diagram of iP-theoretic combinatorial Hopf algebras of Lam and Pylyavskyy 


Using Takeuchi’s formula |Tak71] . they give a formula for the antipode for 91TMR but leave 
open the question of an antipode for the remaining Hopf algebras. In this paper, we give the 
first combinatorial formulas for the antipode maps of OJlNSym, mQSym, mSym, and fOTSym. 

Remark 1.1. As there is no sufficiently nice combinatorial formula for the antipode map in 
the Malvenuto-Reutenauer Hopf algebra of permutations, we do not attempt a formula for its 
A-theoretic analogues: IHMR and mMR. 


After a brief introduction to Hopf algebras, we introduce the Hopf algebra mQSym in Sec¬ 
tion Next, we introduce IDTNSym in Section We present results concerning the antipode 

In Section we present an ad- 


map in OUNSym and mQSym, namely Theorems |4.6| and 4.8 


ditional basis for mQSym, give analogues of results in |LP07j for this new basis, and give an 
antipode formula in mQSym involving the new basis in Theorem 5.6 Lastly, we introduce the 


Hopf algebras of multi-symmetric functions, mSym, and of Multi-symmetric functions, IHSym 
in Sections 1^ andWe end with Theorems |8.2 8.3 , and 8^, which describe antipode maps in 
these spaces. 


2. Hope algebra basigs 


2.1. Algebras and coalgebras. First we build a series of definitions leading to the definition 
of a Hopf algebra. For further reading, we recommend |,1R,791 IMon93t IGR14| ISwe69] . 

In this section, k will usually denote a field, although it may also be a commutative ring. In 
all later sections we take fc = Z. All tensor products are taken over k. 


Definition 2.1. An associative k-algehra A is a k-vector space with associative operation m : 
A ® A ^ A (the product) and unit map p : k ^ A with p{lk) = 1a such that the following 
diagrams commute: 


A® A® A 


1 (g) m 


r A® A 


m<S> 1 


m 


m 


^ A 


k® A <-> A < -> A® k 



A 0 A 
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where we take the isomorphisms sending a® k to ak and k ® a to ka. 


The first diagram tells us that m is an associative product and the second that = 1a- 

Definition 2.2. A co-associative coalgebra C is a k-vector space with k-linear map A : (T —)■ C®C 
(the coproduct) and a counit e ■. C ^ k such that the following diagrams commute. 

C -- ^C®C k®C< -=- >C< -=- >C®k 


A 

1 (g) A 

c®c - >c® 

The diagram on the left indicates that A is co-associative. Note that these are the same 
diagrams as in the Dehnition o with all of the arrows reversed. 

It is often useful to think of the product as a way to combine two elements of an algebra and 
to think of the coproduct as a sum over ways to split a coalgebra element into two pieces. When 
discussing formulas involving A, we will use Sweedler notation as shown below: 

A(c) = ^ Ci ® C2 = ^ Cl (g) C2. 

(c) 

This is a common convention that will greatly simplify our notation. 

Example 2.3. To illustrate the concepts just dehned, we give the example of the shuffle algebra, 
which is both an algebra and coalgebra. Let I be an alphabet and I be the set of words on I. 
We declare that the elements of I form a fc-basis for the shuffle algebra. 

Given two words a = aia 2 ■ ■ ■ at and b = 6162 ■ ■ - bn in I, define their product, m(a ®b), to be 
the shuffle product of a and b. That is, m{a®b) is the sum of all (*^"') ways to interlace the two 
words while maintaining the relative order of the letters in each word. For example, 

m{aia 2 ® &i) = aia2&i + 016102 + 61O1O2. 

We may then extend by linearity. It is not hard to see that this multiplication is associative. 

The unit map for the shuffle algebra is defined by r]{lk) = 0, where 0 is the empty word. 
Note that m{a®(l)) = mifj) ® a) = o for any word o. 

For a word o = O 1 O 2 ■ ■ ■ o^ in J, we define 

t 

A(o) = ^ O1O2 ■ ■ - tti ® Oj+iOi+2 ■ ■ - at 

i =0 

and call this the cut coproduct of o. For example, given a word o = 01 O 2 , 

A(o) = 0 ® 01 O 2 + 01002 + 01 O 2 ® 0. 

The counit map is defined by letting e take the coefficient of the empty word. Hence for any 
nonempty o G /, e(o) = 0 . 

2.2. Morphisms and bialgebras. The next step in defining a Hopf algebra is to define a 
bialgebra. For this, we need a notion of compatibility of maps of an algebra (m, p) and maps of 
a coalgebra (A,e). With this as our motivation, we introduce the following definitions. 
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A(g) 1 


J®C 











Definition 2.4. If A and B are k-algebras with multiplication mA and ms and unit maps rjA and 
rjB, respectively, then a k-linear map f : A ^ B is an algebra morphism if f oruA = °{f f) 

and f or]A = rjB- 

Definition 2.5. Given k-coalgebras C and D with comultiplication and counit cc, Ad, and 
Cd, k-linear map g : C ^ D is a coalgebra morphism if Ad o g = {g ® g) o and cd ° g = ■ 

Given two A;-algebras A and B, their tensor product A 0 i? is also a fc-algebra with mA^B 
defined to be the composite of 

1 (g) T (g) 1 mA®rnB . „ 

A® B ® A® B -> A® A® B ® B -> A® B, 

where T{b ® a) = a ®b. For example, we have 

'rriA^Biia ®b) ® {a' ® b')) = mA{a ® a') ® mB{b ® b'). 

The unit map m. A® B, pa^b, is given by the composite 

VA^rjB , 

k —> k ® k -> A® B. 

Similarly, given two coalgebras C and D, their tensor product C ® D is a. coalgebra with 
Ac^d the composite of 

C®D C®C®D®D C®D®C®D, 

and the counit ca^b is the composite 

C ® D -> k®k —> k. 

Definition 2.6. Given A that is both a k-algebra and a k-coalgebra, we call A a k-bialgebra if 
(A, e) are morphisms for the algebra structure (m, p) or eguivalently, if (m, p) are morphisms for 
the coalgebra structure (A,e). 

Example 2.7. The shuffle algebra is a bialgebra. We can see, for example, that 
AomA{ai®bi) = A(ai6i + feiOi) 

= 0 ® aibi -I ai®bi + aibi 0 0 + 0® feiOi + bi® ai biOi ® 0 

= 0 ® (ui&i T biOi) bi ® tti tti ® bi (fli&i + biOi) ® 0 

= 771^(0 0 0) 0 rnA{ai ® bi) + 777^(0 0 &l) 0 777 ^ 1(01 0 0)+ 777A(ai 0 0) 0 777^(0 0 bi) 
+ 777^(01 0 bi) 0 777^(0 0 0) 

= 777a8.a(( 0 0 oi + ai 0 0) 0 (0 0 61 + 61 0 0)) 

= 777a^a o (A(ai) 0 A(6i)). 

This is evidence that the coproduct. A, is an algebra morphism. 

2.3. The antipode map. A Hopf algebra is a bialgebra equipped with an additional map called 
the antipode map. On our way to defining the antipode map, we must first introduce an algebra 
structure on /c-linear algebra maps that take coalgebras to algebras. 

Definition 2.8. Given coalgebra G and algebra A, we form an associative algebra structure on 
the set of k-linear maps from C to A, Homk{C, A), called the convolution algebra as follows: for 
f and g in Homk{C, A), define the product, f * g, by 

if * g){c) = m o {f ® g) o A(c) = fici)g{c 2 ), 
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where A(c) = ^ Ci ® C 2 . 


Note that t] o e \s the two-sided identity element for * using this product. We can easily see 
this in the shuffle algebra from Examples 2.3 and 2.7 if we remember that (r/ o e)(a) = //(O) = 0 
for all words a 7 ^ 0. Let c be a word in the shuffle algebra, then 


(/ * (^ ° e))(c) = ^ /(ci)(r7 o e)(c2) = /(c) = o e)(ci)/(c2) = {{j] o e) * f){c) 


because Ci = c when C 2 = 0 and C 2 = c when ci = 0 . 

If we have a bialgebra A, then we can consider this convolution structure to be on Endk{A) : = 

Homk{A, A). 


Definition 2.9. Let {A,m,ri,A,e) be a hialgehra. Then S G Endk{A) is called an antipode for 
bialgebra A if 

id A * S = S * id A = h ° 
where idA : A ^ A is the identity map. 


In other words, the endomorphism S is the two-sided inverse for the identity map idA under 
the convolution product. Equivalently, if A(a) = X] ® 2 , 

(5 * idA){a) = ^2 S{ai)a2 = ?7(e(a)) = ^ aiS'(a2) = {idA * S). 

Because we have an associative algebra, this means that if an antipode exists, then it is unique. 


Example 2.10. We dehne the antipode of a word in the shuffle algebra by 

5(0102 ■ ■ ■ Ot) = ( —l)*OtOi_i ■ ■ ■ O2O1 

and extend by linearity. We can see an example of the dehning property by computing 
{id * 5)(oi02) = m{id{tlf) ® 5 ( 0102 )) -l- m{id{ai) ® 5 ( 02 )) -l- m(fd(oi 02 ) ® 5(0)) 

= — 02 O 1 — m(oi 0 02 ) -l- 01 O 2 

= —O 2 O 1 — ( 01 O 2 -l- O 2 O 1 ) -|- O 1 O 2 

= 0 

= 77 ( 6 ( 0102 )). 

We end this section with two useful properties that we use in later sections. The hrst is a 
well-known property of the antipode map for any Hopf algebra. 


Proposition 2.11. Let 5 be the antipode map for Hopf algebra A. Then 5 is an algebra anti¬ 
endomorphism: 5(1) = 1, and S{ab) = S{b)S{a) for all a, b in A. 

The second property allows us to translate antipode formulas between certain Hopf algebras. 

Lemma 2.12. Suppose we have two bialgebra bases, and {B^}, that are dual under a 

pairing and such that the structure constants for the product of the first basis are the structure 
constants for the coproduct of the second basis and vice versa. In other words, (A^, B^) = 
AxA^ = ^ fl^A,, and A{Bx) = ^ f^,yB^ 0 B,,; and A(Aa) = ^ h^^ ,^A^ 0 A^ and BxB^, = 

U /J.,P 

'I 

V 

V 
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for S satisfying 0 = E h^,,S{A^)A^, then 

S{B,) 




satisfies 


Proof. Indeed, 


E A, 






y ^ f^,u,'y^'i,r'B^By^ A.J 
y ^ fiJ,,u,'f^'r,iJ'^^,uBp, At 

77 

5 a , hl,k,^,fP^,A, 

p,p,jAn 

B\i y ^ h.y j^k.y^fj^Afj^Ap 


z/,7 


= 0 


by assumption. □ 

3. The Hope algebra oe multi-quasisymmetric eunctions 

In what follows, we say that a set {^a} continuously spans space A if everything in A can 
be written as a (possibly inhnite) linear combination of Aa’s. Here, we assume that {Ha} comes 
with a natural hltration and that each hltered component is hnite. Then we may talk about 
continuous span with respect to the topology induced by the hltration. A continuous basis for 
A allows elements to be written as arbitrary linear combinations of the basis elements. We say 
that a linear function / : H —)• H is continuous if it respects arbitrary linear combinations of 
elements in A. 

We next introduce the multi-quasisymmetric functions, mQSym. It may be useful for the 
reader to be familiar with the Hopf algebra of quasisymmetric functions, specihcally the basis of 
fundamental quasisymmetric functions. We recommend |Sta99j for background reading. 

3.1. (P, 6')-set-valued partitions. Following |LP07] . we dehne mQSym, the Hopf algebra of 
multi-guasisymmetric functions, by dehning the continuous basis of multi-fundamental quasisym¬ 
metric functions, L^. Let [n] = {1,2,... ,n}. We start with a hnite poset P with n elements 
and a bijective labeling 6^ : P —)■ [n]. Let P denote the set of nonempty, hnite subsets of the 
positive integers. If a G P and 6 G P are two such subsets, we say that a < 6 if max{a) < min{h). 
Similarly, a < 6 if max{a) < min{b). 
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We next define the (P, 6 ')-set-valued partitions. The dehnition is almost identical to that of 
the more well-known (P, 6 ')-partitions except that we will assign a nonempty, hnite subset of 
positive integers to each element of the poset instead of assigning a single positive integer. We 
recommend |Sta99j for further reading on (P, 6 *)-partitions. 

Definition 3.1. Let {P,9) be a poset with a bijective labeling. A {P,9)-set-valued partition is a 
map cr : P —)■ P such that for each covering relation s <t in P, 

(1) a{s) < a{t) if 9{s) < 9{t), 

(2) cr(s) < a{t) if 9ls) > 9{t). 

Example 3.2. The diagram on the left shows an example of a poset P with a bijective labeling 
9. We identify elements of P with their labeling. The diagram on the right shows a valid (P, 9)- 
set-valued partition a. Note that since 3 < 2 in the poset, we must have the strict inequality 
max{a{3)) = 6 < min{a{2)) = 30. 

2 a(2) = {30,31,32} 


4 


a(4) = (7,100} 



a(l) = {1,3,6} 


{ 6 } 


We denote the set of all (P, 6 *)-set-valued partitions for given poset P by .4.(P, 6 *). For each 

element i in P, let o'~^{i) = {x E P \ i E o'ix)}. Now define Kpe E X[[xi,X 2 , ■ ■ .]] by 

- ST 

X 2 

<T&A{Pfi) 

For example, the (P, ^j-set-valued partition in the previous example contributes 

XiX‘ixlxjX:iOX^lXz2XlOQ 

to Kpfi. Note that Kp 0 will be of unbounded degree for any nonempty poset P. 

We may also consider a Young diagram A as a poset in the natural way as follows. Let P 

be the poset of squares in the Young diagram of a partition A = (Ai, A 2 ,..., A^) and 9s be the 

bijective labeling of P obtained from labeling P in row reading order, i.e. from left to right the 
bottom row of A is labeled 1,2,..., Aj, the next row up is labeled A^ -|- 1,..., A^ -|- At_i and so on. 
We may thus refer to the function Kxp^ ■ We will see this idea next in Example 

3.2. The multi-fundamental quasisymmetric functions. A composition of n is an ordered 
arrangement of positive integers that sum to n. For example, (3), (1,2), (2,1), and (1,1,1) are 
all of the compositions of 3. 

If S' = {si, S 2 , ■ • • 5 Sfc} is a subset of [n — 1], we associate a composition, C(S'), to S by 
S 2 — Si, — S 2 ^ ■ ■ ■ ,n — Sk}. To composition a of n, we associate S'^ C [n — 1] by 
letting Sa = {«!, 0.1 + 0 . 2 ,... ,ai + 02 + ■ ■ ■ + a/c-i}- We may extend this correspondence to 
permutations by letting C{w) = C{Des{w)), where w E &n and Des{w) is the descent set of w. 
For example, if S' = {1,4, 5} C [6 — 1], C(S') = (1,4 — 1, 5 — 4, 6 — 5) = (1, 3,1,1). Conversely, 
given composition a = (1, 3,1,1), Sa = {1,1 -|- 3,1 -|- 3 -|- 1} = {1,4, 5}. For w = 132 G © 3 , 

7 


5.5 







Des{w) = {2} and C{w) = (2,1). Given a composition a of n, we write to denote any 
permutation in with C{wa) = a. 

We may now define the multi-fundamental quasisymmetric function La indexed by composi¬ 
tion a. 


Definition 3.3. Let P be a finite chain pi < p 2 < ■ ■ ■ < Pk, w E &k a permutation, and C{w) = a 
the composition of n associated to the descent set of w. We label P using w with 6{pi) = Wi. 
Then 


La = K 


{P,w) 


u&A{P,w) 


X 


^( 2 ) 




It is easy to see that K(^p^w) depends only on a. Note that this is an inhnite sum of unbounded 
degree. The sum of the lowest degree terms in La gives La, the fundamental quasisymmetric 
function in QSym. 

Example 3.4. Let a = (2,1) and Wa = 231. We consider all (P, taQ,)-set-valued partitions on 
the chain shown below on the far left. The seven images to its right show examples of images of 
the map a. 

1 {2} {3} {3} {3,4} {4} {101} {100,101} 


3 {1} {1} {2} 


{2} {2,3} {7,100} {7} 


2 {1} {1} {1} {1,2} {1,2} {5,6,7} {5,6,7} 

Using the examples above, we see that 

L(2P) = xlx2 + xfxs + X 1 X 2 X 3 + 2 Xixlx 3 X 4 2x^Xf:,x‘^^XioQXiQi + ..., 


an inhnite sum of unbounded degree. 

For the following dehnition, we order P as in Section 


3.1 


Namely, for subsets a and b, we say 


a < 6 if max{a) < min{b) and a < 6 if max{a) < min{b), though we shall only need the latter 
notion. 


Definition 3.5. Given a poset P with n elements, a linear multi-extension of P by [iV] is a map 
e : P —)■ 2['^1 for some N > n such that 

(1) e{x) < e{y) if x < y in P, 

(2) each i E [iV] is in e(x) for exactly one x E P, and 

(3) no set e{x) contains both i and i + 1 for any i. 

For e any linear multi-extension of P by [N] and any i E [iV], let e~^{i) denote the unique 
element p of P such that i E e{p). Note that e~^{{i}) may be empty while e~^{i) always contains 
exactly one element of P. We then dehne the multi-Jordan-Holder set J{P, 6) = UpiJpi^P, 6) to 
be the union of the sets 

Jn{P, 0) = {6{e~^{l))6{e~^{2)) ■ ■ ■ 6{e~^{N)) | e is a linear multi-extension of P by [N]}. 

Note that elements in Jn{P, 0) are m-permutations—pronounced “multi-permutations”— |LPn7] 
of [n] with N letters, where we dehne an m-permutation of [n] to be a word in the alphabet 
1, 2,..., n such that no two consecutive letters are equal. 





















Example 3.6. Consider again the labeled poset below. 


2 


We can define a linear mnlti-extension of P by [7] by e(l) = {!}, e(3) = {3, 5} e(4) = {2,4, 6}, 
and e(2) = {7}. Then, for example, e“^(5) is the element of P labeled by 3. This linear mnlti- 
extension contribntes the m-permutation 1434342 to J'y{P,9). 


The following resnlt is proven in |LPn7] by giving an explicit weight-preserving bijection 
between A{P,9) and the set of pairs (w,a') where w G J'p^{P,9) and a' G A{C,w), where 
C = (ci < C 2 < ... < Cr) is a chain with r elem ents. One can easily recover this bijection from 

by restricting to A{P, 9). 


5.4 


the bijection given in the proof of Theorem 
Theorem 3.7. |LP07[ Theorem 5.6] We can write 

^(P,e) = X] 


^>^wejN(p,e) 


-‘ C ( w ) ■ 


We now describe how to express La as an infinite linear combination of fnndamental qua- 
sisymmetric fnnctions, {La}. Let l}}} denote the homogeneous component of La of degree |q!| Pi. 

Given D C [n —1] and E C [n-|-i —1], an injective, order-preserving map t : [n —1] —)■ [n-f-z —1] 
is an i-extension of 77 to E if t{D) C E and {E\t{D)) = {\n + i — l])\f([n — 1]). In other words, 
E is the union of the image of D and the elements not in the image of t. Thus \E\ = \D\ + i. 
Let T{D,E) denote the set of z-extensions from D to E. For example, ii D = {1,2} C [2] and 
E = {1,2,3} C [3], then \T{D,E)\ = 3. On the other hand, if we have D' = {1,2} C [3] and 
E' = {1,3,4} C [4], then \T{D'.,E')\ = 0. The proof of the following theorem is similar to that 
of Theorem 15.11 


Theorem 3.8. |LPn7l Theorem 5.12] Let a be a composition of n and D = Des{a) be the 
corresponding descent set. Then for each i >0, we have 

E \nD,E)\LciEy 

E(Z[n+i—l] 

3.3. Hopf structure. Next we describe the bialgebra structure of mQSym using the continuous 
basis of multi-fundamental quasisymmetric functions. The first step is to define the multishuffle 
of two words in a fixed alphabet. To that end, we give the following definition. 


Definition 3.9. Let a = aia 2 ■ ■ ■ Ok be a word. We call w = wiW 2 ■ ■ -Wr a multiword of a if there 
exists a non-decreasing, surjective map f : [r] —)■ [k] such that Wj = apj). 

As an example, consider the permutation 1342 as a word in N. Then 11333422 and 1342 are 
both multiwords of 1342, while 34442 and 1133244 are not multiwords of 1342. 


Definition 3.10. Let a = aia 2 ■ ■ ■ ak and b = 6162 ■■ - bn be words with distinct letters. We say 
that w = W 1 W 2 ■ ■ ■ Wm is a multishuffle of a and b if the following conditions are satisfied: 
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(1) Wi 7^ Wi+i for all i 

(2) when restricted to {oj}, w is a multiword of a 

(3) when restricted to {bj}, w is a multiword ofb. 

Eventually we would like to multisliuffle two permutations, which will not have distinct 
letters. We adjust our dehnition as follows. Given a permutation w = wiW 2 ■ ■ ■ Wk, define 
w[n] = {wi + n){w 2 + n) ■ ■ ■ {wk + n) to be the word obtained by adding n to each digit entry 
of w. For example, for w = 21, tc[4] = 65. We then dehne the multishuffle of two permutations 
u G &n and w by declaring it to be the multishuffle of u and w[n]. 

Starting with permutations u = 1342 and w = 21, we see that v = 16161346252 is a multi¬ 
shuffle of M = 1342 and w[4] = 65. We shift why A since 4 is the largest letter in u. If we restrict 
to the letters in u, v\u = 1113422 is a multiword of u, and similarly u|i„[4] = 6665 is a multiword 
of w[A\. 

Proposition 3.11. |LP07t Proposition 5.9] Let a be a composition of n and ft be a composition 
ofm. Then 

LaLp ^ ^ L(Pu)^ 

uSSh™ (wcW,3[n]) 

where the sum is over all multishuffies of and wp[n]. 

Note that this is an infinite sum whose lowest degree terms are exactly those of L^Lp, the 
product of the two corresponding fundamental quasisymmetric functions. 

To define the coproduct, we need the following definition. 

Definition 3.12. Let w = wiW 2 ■ ■ - Wk he a permutation. Then Cuut{w) is the set of terms of 
the form W 1 W 2 ■ ■ ■ Wi^ Wi+iWi +2 ■ ■ -Wk for i G [0, k] or of the form W 1 W 2 ■ ■ -Wi^ WiWi+i ■ ■ -Wk for 
i G [1, k]. 

For example, Cuut(132) = {00132,10132,1032,13032,1302,13202,13200}. Notice how 
this compares to the cut coproduct of the shuffle algebra described in Section to understand 
the strange spelling. 

Proposition 3.13. [LPOTl Proposition 5.10] We have that 

A(L„) = La{x,y) = ^ Lc(u){x) ®Lc{u'){y)- 

G Cuut (ioq ) 

Example 3.14. Let a = (1) and ft = (2,1) with Wq, = 1 and wp = 231. Then 


LaLp — T(3,1) + -^(1,2,1) + L(2,2) + -^(2,1,1) + -^(3,1,1) + -f"(2,2,l,l) + T(2,2,l,2) + • • • , 

where the terms listed correspond to the multishuffles 1342, 3142, 3412, 3421, 13421, 131421, 
and 3414212 of Wa and ta/ 3 [l]. We also compute 


A{Lp) = 


42,1) 


+ L 


( 1 ) 


42,1) 


+ L 


( 1 ) 


414) 


+ L 


( 2 ) 


414) 


-|-L(2) 0 T(i) -|- T(2 ,i) 0 T(i) -|- T(2 ,i) 


We give a combinatorial formula for the antipode map in mQSym in Theorem 4^ In Section 
we give an antipode map in terms of a new basis introduced within the section. 
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4 . The Hope algebra of Multi-noncommutative symmetric functions 


The Hopf algebra of noncommutative symmetric functions (NSym) is dual to that of qua- 
sisymmetric functions. We next describe a i^-theoretic analogue called the Multi-noncommutative 
symmetric functions or QJlNSym. As with QSym, we recommend hrst being familiar with NSym 
as recommend |Sta99] as a reference. We recall the bialgebra structure of QJlNSym as given in 
|LP07j and develop a combinatorial formula for its antipode map. 


4.1. Multi-noncommutative ribbon functions and bialgebra structure. OHNSym has a 
basis {Ra} of Multi-noncommutative ribbon functions indexed by compositions, which is an 
analogue to the basis of noncommutative ribbon functions for NSym. 

A ribbon diagram is a connected skew shape A//x that contains no 2 x 2 square. There is an 
easy bijection between compositions and ribbon diagrams, where a ribbon diagram corresponds 


to the composition obtained by reading the sizes of its rows from bottom to top. See Example 4.2 


It will be useful to think of {Ra} as being indexed by ribbon diagrams using this correspondence. 
We first introduce a product structure on [Ra] as given in |LP07j . 


Proposition 4.1. |LPn7t Proposition 8.1] Let a = (oi,..., ak) and (3 = ..., (dm) be compo¬ 

sitions. Then 

Ra * Rfi Ra<f} T Ra-fi T Ra>fii 

where a <i /3 = (oi,..., a*,, /3i,..., /3m), a ■ [3 = (oi,..., ak-i, -t- /3i - 1, /? 2 , • • •, l3m), and 
a> /3 = {ai,...,ak + /3 i,/ 32,...,/3m)- 


Example 4.2. It is helpful to think of the product using ribbon diagrams. From the statement 
above, we have 

R{2,2) • R{1,2) = R{2,2,1,2) + R{2,2,2) + R{2,3,2)- 
In pictures, this is shown in Figure 




Figure 3 . Multiplying R { 2 , 2 ) and R { i , 2 ) 


In contrast to the product in mQSym, the product in fOTNSym is a finite sum whose highest 
degree terms are those of the corresponding product RaRg in NSym. 

Proposition 4.3. The coproduct of a basis element is 

A{Ra) = ^ Rg <8) Rs, 

WaeSh”^{wp,ws[i]) 

where i G N and Wp E Gi. 

Note that since multishuffles of wp and may not have adjacent letters that are equal, 
we may define the descent set of a multishuffle of wp and ws[i\ in the usual way. 
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Example 4.4. In general, compnting the coprodnct in OJlNSym is not an easy task. However, 
for compositions with only one part, we have 

^(-R(n)) = R{n) ® 1 + R(n-1) 8) R[l) + R[n-2) ® R{2) + • • • R{1) ® R(n-1) + 1 0 R[n} 

becanse the only way that a mnltishnffle of two permntations results in an increasing sequence 
is for it to be the concatenation of two increasing permutations. We use this fact in the proof of 
the antipode in fOTNSym. 


4.2. Antipode map for iDTNSym. Suppose we have a ribbon shape corresponding to a, a 
composition of n. We say that ribbon shape /3 is a. merging of ribbon shape a if we can obtain 
shape (3 from shape a by merging pairs of boxes that share an edge. The order in which the 
pairs are merged does not matter, only set of boxes that were merged. Let be the number 
of ways to obtain shape f3 from shape a by merging. We will label each box in the ribbon shape 
to keep track of our actions. 


Example 4.5. Let a = (2,2,1) and (3 = (2,1). Then = 3. The labeled ribbon shape a 


and the three mergings resulting in shape /3 are shown in Figure 4.5 




1 


1 


2 

CO 


245 

3 

4 

5 






123 

4 

5 



1 

4 

235 


Figure 4. Ribbon shape (2, 2,1) and its three mergings of ribbon shape (2,1) 


In the following sections, oj will denote the fundamental involution of the symmetric functions 
defined by u:{en) = for elementary symmetric function e„, complete homogeneous symmetric 
function and for all n. 

If a = («!,..., ctfc) is a composition of n, define rev{a) = («*,,..., ai). Now let u;{a) be the 
unique composition of n whose partial sums form the complementary set within [n — 1] to 
the partial sums Srev{a)- Alternatively, we may think of the ribbon shape a as A//i for Young 
diagrams A and fi. Then a;(Q!) is the ribbon shape A*//r^ where A* and /r* are the transposes of 
A and /r, respectively. The number of blocks in each row of u{a) reading from bottom to top 
corresponds to the number of blocks in each column of a reading from right to left. For example, 
if« = (2,l,l,3),a;(«) = (l,l,4,l). 

Theorem 4.6. Let a be a composition of n. Then 

R(R„) = (-!)" 

0 

where we sum of over all compositions (3. 

Note that only finitely many terms will be nonzero because = 0 if |/d| > |a|. 


Proof. We prove this by induction on the number of parts of the composition a. 
We compute directly that 


0 = R(R(i)) = 5(R(i)) ■ 1 + 5(1) ■ R(i) = 5(R(i)) + %) 


by Proposition 


2.11 


so 


5(R(i)) 
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fc-1 


k-1 


Now assume that S{R(^k)) = (~1)^ Eh i+i for all k < n. Then, using Example 

*=o ^ * 


and Dehnition 2.9, we see that 


4.4 


n—1 


0 — R(n) + S{R(^n)) + *S'(i?p)) • R, 


(n-i) 


2=1 

n—1 


2—1 


R(n) + S{R(n)) + ^ j ]R{V+i) ) • R{n-i) 


2=1 

n—1 2—1 


i — 1 


i — 1 


— R{n) + S(R(^n)) + Em)-E(',‘) + R(^ij^n-i+l) + R{V,n-i))- 

i=l j=0 V / 

There are hve types of terms that appear in this sum. 

(1) Rn ri —m . The coefficient of this term is 


(- 1 ) 


, n - m - 1\ =0 

n — m — lj \n — m. 


(2) R(rn), where 1 < m < n. The coefficient of this term is 

(3) R(i<!^m), where s < n — m, and m > 1. The coefficient of this term 


(- 1 ) 




n-m-1 , 


(4) where k < n. The coefficient of this term is 


(5) R(n)- The coefficient of this term is 


Thus 


and so 




0 = S(fl,„,) + (-l)”-'^('” fift., 


S = 1 


S — 1 


n—1 


S(fl(n)) = (-l)”E("/)^<-«)- 


s=0 


It is clear that there are mergings of u:{a) = (!"') that result in shape since we 

are choosing s of the n — 1 border edges to remain intact. 

Now suppose S{Ra) = (—I)"" holds for all compositions a with up to fc — 1 

4 

parts, and let /? = (/di, /d 2 , • • •, /dfc) be a composition with k parts. We know that 
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-R/3 - -R(/3i,/32,...A-2A-i) • R { 0 k ) - -R(/3i,/32,...A_2A_i+/Jfc) - -R(/3i,/32,...,/3fe-2,/3fe-i+/3fc-l)) 

and so 

S'(/?(y3j^^^2,.",/3fe-2>/3fc-l+/3fc —1)) • 

In Fignre let the thin rectangle represent all mergings of uj{(3k) and the sqnare represent 
all mergings of u{/3i,..., /3k-i). 


(1) (2) (3) 

Figure 5. NSym antipode merging schematic 

Then the image labeled (1) represents all mergings obtained by adding the last part of a 
merging of oj{(3k) to the hrst part of a merging of a;(/3i,..., (3k-i). The image labeled (2) represents 
all mergings obtained by merging the topmost box in a merging of uj{l3k) with the bottom leftmost 
box of a merging of u){/3i,..., (3k). These two mergings with mnltiplicities are exactly the shapes 
we want in S^Ris). 

The image labeled (3) represents all mergings obtained by concatenating a merging of u}{(3k) 
with a merging of a;(/3i,... ,(3k-i). We do not want these mergings to appear in S{R^) becanse 
it is impossible for boxes that are side-by-side in uj{f3) to be stacked one on top of the other in 
a merging of u){(3). 

We nse the fact that resnlts in all mergings of type (1), (2), and (3), 

S{R{pi,...A-i+3k)) gives all mergings of type (2) and (3), and S{R(^i3^^...,/3^,_.,+Pk-i-)) contains exactly 
those mergings of type (2). The parity of the sizes of the compositions provides the necessary 
cancellation and leaves ns with all mergings of type (1) and (2), as desired. □ 

Example 4.7. Consider S{R(i^ 2 )) = S{R(^i)) • S{R(^i^i)) — S{R(^i^i^i)) — S'(.R(i_i)). The image 
below shows all of the mergings in S'(i?(i)) • in the hrst line with the proper sign, 

snbtracts mergings of in the second line, and snbtracts mergings of S'(i?(i^i)) in the 

third line. The black boxes represent mergings of Ci;(l) = (1), the white boxes represent mergings 
of a;(l, 1) = (2), and the gray boxes represent boxes where the two shapes have merged. 
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4.3. Antipode map for mQSym. We k now from |LPn7| Theorem 8.4] that the bases {La} and 
{Ra} satisfy the criteria in Lemma 2.12[ Extending the dehnition below by continnity gives the 


following antipode formula in mQSym. 


Theorem 4.8. Let a be a composition of n. Then 

S{La) = 

where the sum is over all compositions f3. 

Note that while S{Ra) is a hnite sum of Multi-noncommutative ribbon functions for any a, 
S{La) is an inhnite sum of multi-fundamental quasisymmetric functions for any a. Since any 
arbitrary linear combination of multi-fundamental quasisymmetric functions is in mQSym, this 
is an admissible antipode formula. 


5. A NEW BASIS FOR mQSym 

5.1. (P, 0)-multiset-valued partitions. To create a new basis for mQSym, which will be useful 
in Ending antipode formulas, we extend the definition of a (P, 6*)-set-valued partition to what we 
call a (P, 6)-multiset-valued partition in the natural way. In a (P, 6')-multiset-valued partition a, 
we allow a{p) for p G P to be a finite multiset of positive integers, keeping all other definitions 
the same. An example of a (P, 6')-multiset-valued partition is shown in Figure]^ 


2 


a(2) = {25,25,25,31} 



Figure 6. A (P, 6')-multiset-valued partition 


Now define .4.(P, 9) to be the set of all (P, 6')-multiset-valued partitions. For each positive 
integer i, let cr~^{i) be the multiset [x E P \ i = cr(a;)}. In other words, lists p E P 

once for each occurence of i in cr(p). In the example in Figure (T“^(1) = (1,1, 3}. Now define 
kp^e E Z[[xi,X 2 , ...]] by 

kpp = 

aeAiPp) 

Using this multiset analogue of our definitions, we define 


hi)™#o' h2) 

Xl 


La = K, 




(7^A{P,w) 
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X 


^(2) 


Xn 

















where P = pi < ... < is a finite linear order and w G &k with C(w) = a. 

5.2. Properties. Recall the definition of T{D,E) from Section]^ For the proof of the fol¬ 
lowing theorem, it may be useful to review the (P, t(;)-partition definition of the fundamental 
quasisymmetric function La- 


L 


OL - 


/ , "''l "''2 


u&A(P,w) 

where C{w) = a and .4,(P, w) is the set of all (P, tc)-partitions. We refer the reader to [LPOT] for 
further reading as we use the same notation. The following proof is almost identical to the proof 
of the analogous result for La given for Theorem 5.12 in |LP07j . 


Theorem 5.1. Let a he a composition of n and D{u{a)) = Des{u{a)). We have that 

Y. \nD[oj{a)),E)\L^^ciE)y 

E<Z[n+i—l] 


Proof. Let w = Wa and consider the subset Ai{C,w) C A{C,w) consisting of multiset-valued 
(C, r(;)-partitions a of size |ct| = n + i, where C = (ci < C 2 < • • • < c^) is a chain. We must show 
that the generating function of Ai{C,w) is equal to 

|r(D(u,(a)),£)|L„,c,E)|. 

Ec[n+i—l] 

Indeed, for each pair t G T{D{oj{a)), E) for some P, the function L^(c{e)) is the generating 
function of all a G Ai{C,w) satisfying \cr{cj)\ = t{n — {j — 1)) — t{n — j)), where f(0) = 0 
and t{n) = n + i. Letting C' = A < A,..., be a chain with n + i elements, we obtain a 
(C',Ci;(C(P)))-partition a' G A{C',u{C{E))) by assigning the elements of (j(ci) in increasing order 

Example 5.2. Letting a = (1, 2,1, 2), we see that 

La'^ = L(2,2,1,2) + 2L(i,3,i, 2) + -h(l,2,2,2) + 2L(i,2,1,3)- 

In this example, the coefficient of L(i, 3 ,i, 2 ) is 2 because 

|T(P(n;(l,2,l,2)),{l,4,5}c [n + l-l = 6])| = |T(P(1, 3, 2), {1,4, 5})| 

= |T({2,4},{1,4,5})| 

= 2 . 


Given the basis of multi-quasisymmetric functions, {La}, the set {La} is natural to consider 
because of the next proposition. We remind the reader that co{La) = L^(^a) in QSym. 

Proposition 5.3. We have oj{La) = Lij{a), and the set of {La} forms a continuous basis for 
mQSym. 


Proof. Using Proposition 5.1 


I 5: \T(D(a),E)\LciE)\ - Y \T{D{a), E)\L^(C{e)) - L^i^a)- 

.i?C[n+i—1] J i?C[n-|-i—1] 


□ 


We have an analogue of Stanley’s Fundamental Theorem of P- partitions for our new basis of 
La's. The proof of this result follows closely that of Theorem 3.7 in this paper given in [LPOTj. 
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Theorem 5.4. Suppose poset P has n elements. We have 

Kp,e =Y1 

Proof. We prove this result by giving an explicit weight-preserving bijection between A{P, 9) and 
the set of pairs (ta, a') where w G Jn{.Pi 9) and a' G A{C, w) where (7 = (ci < C 2 < • • • < q) is 
a chain with I = i{w) elements. Let a G A{P,9)- For each i, let cr“^(z) denote the submultiset 
of [n] via 9, and let denote the word of length |cr“^(z)| obtained by writing the elements of 


a 


-1 


(i) in increasing order. Note that it is possible for This will occur when the 




letter i appears more than once in some cr(s) for s G P 
Let w denote the unique m-permutation such that Wa := 
t : i{wa) —)■ i{w) be the associated function as in Dehnition |3.9 
word because cr^“^^(r) = 
a' G A{C, w) by 


is a multiword of w and 
We know that is a hnite 
for sufficiently large r. Note that w^j uses all letters [n]. Now dehne 


cr'{ci) = {r^ I r is a positive integer and contributes k letters to Wo-lt-ip)} 

where tCcrlt-qq is the set of letters in Wa at the positions in the interval We will show that 

this dehnes a map a : a ^ {w, a') with the required properties. 

First, w is the m-permutation associated to the linear multi-extension e^ of P by [f'(tc)] 
dehned by the condition that e^(a:) contains j if and only if wj = 9{x). It follows from the 
dehnition that this e^ '■ P ^ is a linear multi-extension. To check that a' is a multiset¬ 

valued (C, ta)-partition, we note that a'(cj) < (j'(cj+i) because the function t is non-decreasing. 
Moreover, if Wi > tCj+i, then A{ci) < cT'(ci+i) because each is weakly increasing. 

We dehne the inverse map {3 : (w, a') h->■ a by the formula 

a{x) = IJ ct'(cj). 

The (P, 0)-multiset-valued partition a respects 9 because is a linear multi-extension. Thus if 
X < y m. P and 9{x) > 9{y), then a{x) < a{y) since e^(a;) < e^iy) and there is a descent in w 
between the corresponding entries of 9{x) and 9{y). 

Then (3 o a = id follows immediately. For a o (3 = id, consider a submultiset cr'(cj) C a{x). 
One checks that this submultiset gives rise to |cT'(cj)| consecutive letters all equal to 9(x) in Wa- 
and that this is a maximal set of consecutive repeated letters. This shows that one can recover 
a'. To see that w is recovered correctly, one notes that if cr'(cj) and a'(cj+i) contain the same 

(r) 

letter r then wj < tCj+i so by dehnition wj is placed correctly before Wj+i m. Wa . 

□ 


Example 5.5. Let 9 be the labeling 


3 

4 

5 

1 

2 



of the shape A = (3,2). (Note that this is the labeling 9s 
(A, 6*)-multiset-valued partition 


described in Section 3.1 ) Take the 


112 

23 

345 

45 

667 
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in ^(A, 6). Then we have 


n;. = (3,3; 3,4; 4, 5; 1,5; 1,5; 2, 2; 2), 

where for example, = (3, 3) since the cell labeled 3 contains two copies of the number 1 in 
a. Therefore 

w = (3,4, 5,1,5,1,5,2) 

and the corresponding composition C{w) is (3, 2, 2,1). Then a' written as sequence is 

{1,1, 2}, {2, 3}, {3}, {4}, {4}, {5}, {5}, {6,6, 7}. 

For example cr'(ci) = {1,1,2} since contributes two 3’s and contributes one 3 to the 
beginning of tCo-. 

To obtain the inverse map, /3, read w and a' in parallel and place cr'(ci) into cell 6j^{wi). For 
example, we put (1,1, 2} into the cell labeled 3, and we put (2, 3} into the cell labeled 4. 

The linear multi-extension, in this example can be represented by the hlling below. 


1 

2 

357 

46 

8 



5.3. Antipode. Recall that in QSym, 


5(L„) = (-l)l“lL^(„) = (-l)l“la;(L„) = uj{L^{-Xu -X2, • ■ ■))• 
Using the set {La}, we have a similar result in mQSym. 

Theorem 5.6. In mQSym, 

S(^La') Li^(^a)i^ ^ 1 ) X2, ■ ■ .). 


Proof. Using Theorem 3.7 and the antipode in QSym, we see that 


S{La) 


S\ Yl \nD,E)\LciE, 

I i?c[n-|-j—1] 


ino, E)\S(Lc(e)) 

Ec[n+i—l] 


Y |T(£>,B)|(-1)PWIL„,c(e)) 

Ec[n+i—l] 

Lio[a){, 2 ^ 2 ) ■ • •)• 


□ 


6. The Hope algebra of multi-symmetric functions 

We next describe the space of multi-symmetric functions, mSym. We refer the reader to 
pypoTj for details. 
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6.1. Set-valued tableaux. Recall the definition of Kx q^ from Section 3.1 We define 

mSym = 




to be the snbspace of mQSym continuonsly spanned by the Kxg^, where A varies over all parti¬ 
tions. From this point forward, we will write K\ in place of Kx^g^ and call a (A//r, 6's)-set-valned 
partition a set-valued tableau of shape A//r. We will think of these tableanx as fillings of a Young 
diagram with finite, nonempty subsets of positive integers such that the subsets are weakly 
increasing across rows and strictly increasing down columns, where subsets are ordered as in Sec¬ 
tion 3.2 For any set-valued tableau T, |T| denotes the sum of the sizes of the subsets labeling 


the boxes of T. 


Example 6.1. For A = (2,1), we have Kx = x\x 2 + 2xiX2X^ -f- x\x\ + ?ix\x 2 X 2 , + SxiX 2 Xy,Xi -f-..., 
corresponding to the following labeled poset. 


3 1 



2 


The set-valued tableaux corresponding to the first four terms are shown below. Note that we 
omit commas in the subsets—the box in position row one and column two of the fourth tableau 
is filled with {1, 2}. 


1 

1 


1 

2 


1 

3 


1 

12 


1 

12 


1 

13 


1 

1 

2 


3 


2 


2 


3 


2 


23 



6.2. Basis of stable Grothendieck polynomials. We now introduce another (continuous) 
basis for mSym, the stable Grothendieck polynomials. Stable Grothendieck polynomials origi¬ 
nated from the Grothendieck polynomials of Lascoux and Schiitzenberger usi. which served as 
representatives of iF-theory classes of structure sheaves of Schubert varieties. Through the work 
of Fomin and Kirillov |FK96] and Buch |Buc02j, the stable Grothendieck polynomials, a limit 
of the Grothendieck polynomials, were discovered and given the combinatorial interpretation in 
the theorem below. These symmetric functions play the role of Schur functions in the iF-theory 
of Grassmannians. 


Theorem 6.2. |Buc02l Theorem 3.1] The stable Grothendieck polynomial Gx/g, is given by the 
formula 

Ga/„ = 


where the sum is taken over all set-valued tableaux of shape X/p,. 

The stable Grothendieck polynomials are related to the Kx by 

Kx{xi,xi, ...) = (-l)'^'GA(-a;i, -X2, ...). 

Remark 6.3. In |Bncn2] . Buch studied a bialgebra F = ©aZGa spanned by the set of stable 
Grothendieck polynomials. Note that the bialgebra F is not the same as mSym. In particular, 
the antipode formula given in Theorem 8.2| is valid in mSym but not in F as only finite linear 
combinations of stable Grothendieck polynomials are allowed in F. 

19 

























































6.3. Weak set-valued tableaux. The following definition is needed to introduce one final basis 
for mSym, { Ja}. 

Definition 6.4. A weak set-valued tableau T of shape X/u is a filling of the boxes of the skew 
shape X/v with finite, non-empty multisets of positive integers so that 

(1) the largest number in each box is stricty smaller than the smallest number in the box 
directly to the right of it, and 

(2) the largest number in each box is less than or egual to the smallest number in the box 
directly below it. 


In other words, we £11 the boxes with multisets so that rows are strictly increasing and 
columns are weakly increasing. For example, the filling of shape (3, 2,1) shown below gives a 
weak set-valued tableau, T, of weight x'^ = xix\x\x\x^xqX'j. 


12 

33 

46 

223 

4 


57 




Let J\iv 
Xjv. 


be the weight generating function of weak set-valued tableaux T of shape 

T 


Theorem 6.5. |LPn7| Proposition 9.22] For any skew shape X/v, we have 

Jxjv 


7. The Hope algebra of Multi-symmetric functions 


7.1. Reverse plane partitions. We next introduce the big Hopf algebra of Multi-symmetric 
function, fhlSym, with basis {(y'A}- fOTSym is isomorphic to Sym as a Hopf algebra, but the basis 
{^fA} is distinct from the basis of Schur functions, {sa} for Sym. 

Definition 7.1. A reverse plane partition T of shape X is a filling of the Young diagram of shape 
X with positive integers such that the numbers are weakly increasing in rows and columns. 


Given a reverse plane partition T, let T{i) denote the number of columns of T that contain 

. Now we may define the dual stable Grothendieck polynomial 


the number i. Then x'^ := 

ieP 


T(i) 


9\= ^ 

sh{T)=\ 

where we sum over all reverse plane partitions of shape A. For a skew shape X/fi, we may define 
g\/^ analogously, summing over reverse plane partitions of shape X/p,. 


Example 7.2. We use the definition of gx to compute 

5f(2,l) = 2X1X2X3 + 2X1X3X4 -f . . . -f- xlx2 + xlx3 + . . . + xl + xl + . . . + X1X2 + X1X3 + . . . 

corresponding to fillings of the types shown below. 
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7.2. Valued-set tableaux. We introduce one more basis for QJlSym, {ja}, which we show in 
the next section is dual under the usual Hall inner product to {Jx} = {(—1)1^1 JA(—a:i, —X 2 , ■ ■.)}. 

Definition 7.3. A valued-set tableau T of shape A//i is a filling of the boxes of X/pt, with positive 
integers so that 

(1) the transpose of the filling ofT is a semistandard tableau, and 

(2) we are provided with the additional information of a decomposition of the shape into a 
disjoint union of groups of boxes, A//i = \_\Aj, so that each Ai is connected, contained in 
a single column, and each box in Ai contains the same number. 


Given such a valued-set tableau, T, let Oj be the number of groups Aj that contain the number 
i. Then := Tliyixfi. Finally, let ja/aj := where the sum is over all valued-set tableaux 

T 

of shape A//r. 


Example 7.4. The image below shows an example of a valued-set tableau. This tableau con¬ 
tributes the monomial X 1 X 2 X 3 X 5 XI to j( 4 , 3 ,i,i). Note that the given assignment of labels will 
contribute eight monomials—one for each possible decomposition. 


1 

CO 

5 

6 

2 

CO 

6 


to 




2 





Proposition 7.5. |LPn7l Proposition 9.25] We have 


8. Antipode results for mSym and QJlSym 

As with mQSym and fhtNSym, there is a pairing {gx,Gfi) = 6 x,ii with the usual Hall inner 
product for Sym dehned by (sa, s^) = (5a, and the structure constants satisfy the conditions of 
Lemma 2.12 See Theorem 9.15 in |LPn7] for details. It follows that 

{uj{gx),uj{Gf,)) = (jA, 4) = <5a,/. 

and 

{jx, K^) = ((-l)I^I^A(-a;i, -X2 ,...), (- 1 )I''IG^(-xi, -X2, ...)) = 

We will use these facts to translate antipode results between mSym and fhtSym. 

Using results from Section]^ the following lemma will allow us to easily prove results regarding 
the antipode map in mSym. 

Lemma 8.1. Let X be a partition of n. We can expand 

Jx = L^{c{w))- 


Proof. We know from Theorem 3T that 

K{p,e) 




-‘ C ( w ), 


SO 


j, = u,{kx = J2 E Urcw) = E E 

^>nw&jN{Pfi) ^>^wejN(P,0) 




□ 
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Recall that in Sym, S{s\) = (—so one may expect similar behavior from Kx and 
Gx- Indeed, we obtain the theorem below. 

Theorem 8.2. In mSym, the antipode map acts as follows. 

(a) S{kx) = -X 2 , ■■■) = and 

(b) 5 (G'a) = (-1)I"IJa = (-l)l^la;(i^A). 

Proof. For the first assertion, we have that 

.S(k,) = .S(J2 Lcm) 

N>nwejN(p,e) 

= E E 

w&jN(P,e) 

N>n 

= Jx{-Xi,-X2,...). 

And for the second assertion, 

S{Gx) = S{{-lt\kx{-x,,-X 2 ,...)) 

= {-lt\S{kx{-X^,-X2,...) 

□ 


By Lemma 2.12 we immediately have the following results in OJlSym. 


Theorem 8.3. We have 

(a) S{jx) = where jx = (-l)l^ljA(-2:i, -X 2 , ■ ■ ■), and 

(b) S{3x) = gx{-xi,-X2 ,...). 


Next, we work toward expanding S{Gx) and S{jx) in terms of {G^} and respectively. 
We introduce two theorems of Lenart as well as the notion of a restricted plane partition. 

Given partitions A and p. with /i C A, define an elegant filling of the skew shape A//i to be a 
semistandard filling such that the numbers in row i lie in [l,i — 1]. In particular, there can be 
no elegant filling of a shape that has a box in the first row. Now let ff^ denote the number of 
elegant fillings of A//i for /i C A and set /a = 0 otherwise. 

Theorem 8.4. |Lennn| Theorem 2.7] For a partition X, we have 

fiDX 

where is the number of elegant fillings of p/X. 

For the second theorem, let rxfj, be the number of elegant fillings of A//i such that both rows 
and columns are strictly increasing. We will refer to such hllings as strictly elegant. 


Theorem 8.5. |Len001 Theorem 2.2] We can expand the stable Grothendieck polynomial Gx in 
terms of Schur functions as follows 

/iDA 
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We next define the combinatorial object that we need to expand S{G\) in terms of 


Definition 8.6. Let \ ^ jj, be nonempty partitions. A restricted plane partition is a filling of 
the boxes of X/pi with positive integers such that the entries are weakly decreasing along rows and 
columns with the following restriction. If box b E \/pi is an outer corner of A (i.e. XU b is a 
partition); define h{b) to be the number of boxes in pi lying above b in the same column as b or 
to the left of b in the same row as b. The label of such a box b must lie in the interval [1, h(6)]. 

We now define the nnmber Pfi. First, Pfi = Q ii pi X, and Pfi = 1 ii X = pi. If /r C A, then 
Pfi is eqnal to the nnmber of restricted plane partitions of the skew shape X/pi. 


Example 8.7. The diagram on the left shows h{b) for each box b in the shape (5, 5, 5)/(4,2) 
that is an onter corner of (4, 2). The diagram on the right shows a restricted plane partition on 
(5,5,5)/(4,2). 




Theorem 8.8. Let X and pi be partitions. Then 

(a) S(GJ = (-1)1''! and 

(b) S&) = (-1 )'''E^a'‘T- 


Proof. We will focns on part (a), and part (6) will follow from Lemma 2.12 
From Theorem 8^, we know that 

S{Gx) = (-1)1^1 Ja, 

so it remains to expand Jx in terms of stable Grothendieck polynomials. 
From Theorem 8^, it easily follows that we can write 

Kx = y^JfdXSf,. 


fiDX 


Applying u to both sides, we have 


Now we can nse Theorem 18.41 to write 


//DA 

■h='£, 

//DA 


Thns the coefficient of G^, in Jx is E ridxft ■ 

// such that 
//DA and 
//^Cz/ 

We describe a bijection between 

(1) partitions of shape jX that contain some pi ^ X snch that the hlling of pi/X is strictly 
elegant and boxes in f p. are filled snch that the transpose is an elegant filling of v jpf 
and 

(2) restricted plane partitions of /X. 
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Note that the transpose of restricted plane partition of shape z/*/A is a restricted plane partition 
of shape z//Ah 

We hrst dehne a map 0 that takes objects in group (1) to objects in group (2). Suppose we 
have such a hlling of shape v^/\ with some p with X G fi G For any box b in z/*/A, let c{b) 
denote the column containing b, r{b) denote the row containing b, d{b) = r{b) + c{b) — 1 denote 
the southwest to northeast diagonal containing b, and Cb denote the integer in box b. 

To obtain a restricted plane partition follow these steps. 

(1) if box b is in p/A, £11 the corresponding box in the restricted plane partition with 0(6) = 
d{b) — Cbi and 

(2) if box b is in z/*/p, fill the corresponding box in the restricted plane partition with 0(6) = 
c(6) - Cfe. 



Figure 7. In this figure, boxes in A are marked with a dot. For box 6 G we 
have c(6) = 4, r(6) = 2, and d{b) = 5. 

It is easy to see that the parts of the restricted plane partition corresponding to shape p/A 
and to fj, are weakly decreasing in rows and columns. We now check that entries are weakly 
decreasing along the seams and are positive integers. If box 6 is in p/A, then Cb < r{b) — 1 
because the filling is strictly elegant. Therefore 

0(6) = d{b) — Cfc > r(6) + c(6) — 1 — (r(6) — 1) = c(6). 

If box a is in fJ,, then 1 < < c(a) — 1 because the transpose of the filling is elegant, so 

1 < 0(a) = c(a) — Ca < c{a) — 1. 

If 6 and a are adjacent, then c(6) < c(a), so 0(6) > 0(a). 

Next, we check that 0(6) G [1, h(6)] for all 6 G u^/X that are outer corners of A (i.e. A U 6 is a 
partition shape). This guarantees that the resulting filling is a restricted plane partition because 
we have already shown the resulting filling is weakly decreasing. 

Suppose such a box 6 is in p/A. Since 6 is an outer corner of A, d{b) = h{b) + 1. It follows 
that 


0(6) = dip) — Cfe = h{b) + I — Cb < h{b), 

as desired. 

Next suppose box 6 described above is in z/*/p. Then 

0(6) = c(6) — Cfe < c(6) — 1 < h{b). 

Beginning with a restricted plane partition of z/*/A, we define a map, ip, to recover p and the 
fillings of fi/X and z/Yh follows. Let 6 be a box in the restricted plane partition. If Cb > c{b), 
then 6 is in /i and 0(6) = d{b) — Cb- Note that eb > c{b) guarantees 0(6) < r(6) — 1, as is required 
to be strictly elegant. 
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If Cb < c(6), then b is in 'ip{b) = c{b) — e^. Here, < c{b) implies that '0(6) < j — 1, 

which is necessary to have a transposed elegant hlling. 

It is easy to see that resulting rows and columns of fi will be strictly increasing, the resulting 
rows of will be strictly increasing, and the resulting columns of z/*//i will be weakly increas¬ 
ing. Thus the image of "0 is a strictly elegant filling of /i/A and a transposed elegant filling of 
z/*/ fi. Clearly the composition of 0 and "0 is the identity, so they are indeed inverses. 

□ 


Note that the antipode applied to G\ gives an infinite sum of stable Grothendieck polynomials 
(see Remark 6.3) while applying S to jx can be written as a finite sum of j’s. This implies that 
while the space spanned by stable Grothendieck polynomials, T, is not a Hopf algebra, the space 
spanned by j’s is a Hopf algebra. 


Example 8.9. To illustrate the bijection described above, consider A = (3,2,1), /i = (3,3, 2, 2), 
and = (5,4,4, 3). The figure on the left is a filling such that /r/A is strictly elegant and the 
transpose of is elegant. The entries in /i/A are in bold. The figure on the right is the 
corresponding restricted plane partition of /\. 




If 6 is the box in the bottom left corner of the partition on the left, we see that 0(6) = 
d{b) — Cft = 4 — 2 = 2. If a is the box in the upper right corner of the partition on the left, we 
have 0(a) = c(a) — Ca = 5 — 4 = 1. In the restricted plane partition on the right, we can see that 
the boxes in positions (4,1), (3,2), (4,2), and (2,3) are in /i/A in the image of 0 since in these 
boxes Cfe > c(6). 
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